Maximum Entropy Analysis - a Companion
نویسنده
چکیده
This is a companion to Robert Niven’s block 4, 2007lectures. I point to an alternative way of deriving the MaxEnt and the MinXEnt-distributions which is claimed to be more fundamental as well as technically a good deal simpler than the standard method via Lagrange multipliers (sic, still what you find in many (any ?) textbook you may pick up in this field). I hope you, the students in Robert’s class, will realize that the method presented offers a deeper understanding with relevant interpretations which focus on what the physicist can do in terms of “describing” or “representing” the system studied, as always respecting the available knowledge. To fully benefit from the approach, you have to understand more of coding and to embark on a more thorough game-theoretical analysis.
منابع مشابه
Maximum Entropy Analysis for G/G/1 Queuing System (TECHNICAL NOTE)
This paper provides steady state queue-size distribution for a G/G/1 queue by using principle of maximum entropy. For this purpose we have used average queue length and normalizing condition as constraints to derive queue-size distribution. Our results give good approximation as demonstrated by taking a numerical illustration. In particular case when square coefficient of variation of inter-arr...
متن کاملMinimization Problems Based on a Parametric Family of Relative Entropies I: Forward Projection
Minimization problems with respect to a one-parameter family of generalized relative entropies are studied. These relative entropies, which we term relative α-entropies (denoted Iα), arise as redundancies under mismatched compression when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the usual r...
متن کاملTransient Entropy Generation Analysis During Wustite Pellet Reduction to Sponge Iron
The present study carefully examined entropy generation during wustite pellet reduction to sponge iron. The finite volume method was used to solve the governing equations. The grain model was used to simulate the reaction rate. The reactant gases including carbon monoxide and hydrogen were converted to water and carbon dioxide after wustite reduction. Entropy is generated by heat transfer, mass...
متن کاملExtropy: a complementary dual of entropy
This article resolves a longstanding question in the axiomatisation of entropy as proposed by Shannon and highlighted in renewed concerns expressed by Jaynes. We introduce a companion measure of a probability distribution that we suggest be called the extropy of the distribution. The entropy and the extropy of an event distribution are identical. However, this identical measure bifurcates into ...
متن کاملA Note on the Bivariate Maximum Entropy Modeling
Let X=(X1 ,X2 ) be a continuous random vector. Under the assumption that the marginal distributions of X1 and X2 are given, we develop models for vector X when there is partial information about the dependence structure between X1 and X2. The models which are obtained based on well-known Principle of Maximum Entropy are called the maximum entropy (ME) mo...
متن کامل